Measuring the Goodness of Orthogonal Array Discretizations for High-Dimensional Continuous-State Stochastic Dynamic Programs
نویسنده
چکیده
This paper describes a state space discretization scheme based on statistical experimental designs generated from orthogonal arrays of strength three with index unity. Chen et al. (1999) employed this eecient discretization scheme in a numerical solution method for high-dimensional continuous-state stochastic dynamic programming (SDP). These OAs are instrumental in reducing the dimensionality of continuous-state SDP. In particular, computationally eecient space-lling measures for these OAs are derived for evaluating how well a speciic OA discretization lls the state space. Comparisons were made with two types of common measures: ones which maximize the average (or minimum) distance between discretization points within the OA and ones which minimize the average (or maximum) distance between discretization points and nondiscretization points lying on a full grid (i.e., points lying on the full grid that are not contained in the OA discretization). OAs of strength three were tested by tting multivariate adaptive regression splines to data from an inventory forecasting continuous-state stochastic dynamic program.
منابع مشابه
Discretizing the State Space for High-Dimensional Continuous-State Stochastic Dynamic Programs
This paper describes a state space discretization scheme based on statistical experimental designs generated from orthogonal arrays of strength three with index unity. Chen et al. (1997) used this eecient discretization scheme to approximately solve high-dimensional continuous-state stochastic dynamic programming (SDP). Prior methods discretized the state space with a nite grid. The orthogonal ...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملOptimization of a large-scale water reservoir network by stochastic dynamic programming with efficient state space discretization
A numerical solution to a 30-dimensional water reservoir network optimization problem, based on stochastic dynamic programming, is presented. In such problems the amount of water to be released from each reservoir is chosen to minimize a nonlinear cost (or maximize benefit) function while satisfying proper constraints. Experimental results show how dimensionality issues, given by the large numb...
متن کاملNeural network and regression spline value function approximations for stochastic dynamic programming
Dynamic programming is a multi-stage optimization method that is applicable to many problems in engineering. A statistical perspective of value function approximation in highdimensional, continuous-state stochastic dynamic programming (SDP) was first presented using orthogonal array (OA) experimental designs and multivariate adaptive regression splines (MARS). Given the popularity of artificial...
متن کاملEpi-convergent discretizations of stochastic programs via integration quadratures
The simplest and the best-known method for numerical approximation of high-dimensional integrals is the Monte Carlo method (MC), i.e. random sampling. MC has also become the most popular method for constructing numerically solvable approximations of stochastic programs. However, certain modern integration quadratures are often superior to crude MC in high-dimensional integration, so it seems na...
متن کامل